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First of all, thanks for 
having me. | am so 
excited to be here! 


Look guys! | am on 
Stage! 
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First, an EOSDIS* 
Overview 


(So where do you work at NASA?) 


“Earth Observing System Data and Information System {i say “ee-oh-ess-diss”) 


Putting EOSDIS in Context 
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Distributed Active Archive Centers (DAACs), archive 
and distribute standard data products produced by 
Science Investigator-led Processing Systems (SIPS) 
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See United 
Setup Animation 


MODO4_L2.A2016355.2135.006.2016355225734.NR That 
2016-12.20724-35-007 to 2016-12-20121 40-002 


Fast 
MODO4_L2.A2016355.2130,006.2016355225739.NR That 


2016-12.20721-30-002 to 2016-12.20T21 35-002 ss 03/23/2003 to 
é : mee iB a 


@ Loop 


‘uiniceneee Poy EET voor 
2016-12-20121-25:002 to 2016-12207 21 30-002 % 


Pause ‘Share GIF 


MODO04_L2.A2016355.2120.006.2016355225811.NR That 
2016-12-20721-20.002 to 2016-12-20721.25.002 


MODO4_L2.2016355,2030.006.2016355215152.NRThaf 
2016-12207 20-30-007 to 2016-12-20720°35 002 


Imagery Centric End Users 
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Data Centric End Users 
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MODO4_L2.A2016355.2140 006 2016355225748 NR That 
2016-12.20721-40.002 to 2016-12.20721.45,002 


https://cmr.earthdata.nasa.gov/search/collections.xml?provider_id= 


PODAAC&keyword=NAVO-L2P-AVHRRMTA_G 


MODO4_12.A2016355.2130,006.2016355225739.NR That 
2016-12-20721-30:002 to 2016-12.2072135 002 h 


ttps://cmr.earthdata.nasa.gov/search/concepts/C179002785-ORN 
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ttps://cmr.earthdata.nasa.gov:443/search/granules.json?concept_i 
]=C179031461-LARC&page_size=1 &page-num=30 


Code Centric End Users 
https://cmr.earthdata.nasa.gov/search 
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https://earthdata.nasa.gov 
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And we are poised for some really big 
missions in the early 2020s", so we ve got 
exciting things on the horizon! 


* NISAR a ee SWOT are going to increase EOSDIS daily total ingest from about 6 
TB/day to ar 110 TB/da ay 


Second, a Quick How To for 
Open Sourcing at NASA 


(ok, how does this work?) 
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Enhanced reuse of custom-developed code across the Federal 
Government can have significant benefits for American taxpayers, 
including decreasing duplicative costs for the same code and 
reducing Federal vendor lock-in.5 


This policy also establishes a pilot program that requires agencies, 


when commissioning new custom software, to release at least 20 
percent of new custom-developed code as Open Source Software 
(OSS) for three years, and collect additional data concerning new 
custom software to inform metrics to gauge the performance of 
this pilot.6 


https://sourcecode.cio.gov 
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Here is the high-level process 
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GATHER 
INFORMATION 


COMPLETE FORMS 


process ensures 
we are inclusive 


in our practices 
and abide by 
federal law 


WORK WITH TECH PERSIST!!! RECEIVE 


APPROVAL AND 
pat 508, CELEBRATE 


built with http://www. its-all-design.com/ba-sketchbook-stencil-visio/ 


NASA releases tons of software! 
SE TRANSFER 
TRANSFER 
P RO GRA M 
NASA SOFTWARE 
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httos://software.nasa.gov/NASA Software Catalog 2017-18.pdf 


What Forms Will | Need? 


New Technology Report - NF1679 (online or via doc template) 


(You will need the assigned NTR number (e.g. “GSC-17610”) for subsequent forms) 


Export Control Form 
Global Concerns Statement 
508 Compliance Statement 


GSFC Software Developer Form 
(aka Software Release Request Authorization or SRRA) 


Open Source Questionnaire 


https://wiki.earthdata.nasa.gov/display/ESDSWG/Software+Release+Process+-+GSFC+Specific 
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Things to Be Prepared to Gather 


List of prior publications related to software (conferences, etc) 


Software Classification 
http://nodis3.gsfc.nasa.gov/displayDir.cfm?Internal ID=N PR 7150 002B &page name=AppendixD 


Distributed Dependencies (a bit more on that later) 
508 Compliance Information (especially for Web Interfaces) 


Contractors must be prepared to release copyright claims 


(more information available at https://software.nasa.gov/ ) 
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NASA-Wide Software Classifications 


Human-Rated Space Software Systems 
Non-Human Space-Rated Software Systems or Large-Scale 
Aeronautics V ehicles 

Class C Mission Support Software or Aeronautic Vehicles, or Major 


Engineering/Research Facility Software 
(eg., Classes A through C are mostly software developed or acquired for Highly Specialized IT systems) 
Class D Basic Science/Engineering Design and Research and Technology 
Software 


Design Concept and Research and Technology Software 


General Purpose Computing, Business and IT Software (Multi-Center 
or Multi-Program/Project) 
General Purpose Computing, Business and IT Software (Single Center 
or Project) 

Class H General Purpose Desktop Software 


Notes: It is not uncommon for a project to contain multiple systems and subsystems having different 


software classes. 


Source 
20 


Relevant NPRs 


NPR 2210.1C 


http://nodis3.gsfc.nasa.gov/displayDir.cfm?2t=NPR&c=2210&s=1C 


NPR 7150.2B 


http://nodis3.gsfc.nasa.gov/displayDir.cfm?Internal ID=N PR 7150 002B &page name=main 


(more information available at https://software.nasa.gov/ ). 
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With Regards to Licensing 


You will almost certainly need to provide a list of distributed 
dependencies. 


https://en.wikipedia.org/wiki/Viral_ license 


Any GPL’d or “viral-licensed” software (or in distributed 
dependencies) will prevent the Office of Patent Counsel 
(OPC) from being able to release your work. 
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With Regards to Licensing 


Releases are done under NASA Open Source Agreement 
(NOSA) 


Apache 2.0 on a case-by-case basis* 
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With Regards to Licensing 


NASA Open Source Agreement (#NASA) 


The NASA Open Source Agreement, version 1.3, is not a free software license 
because it includes a provision requiring changes to be your “original creation”. 
Free software development depends on combining code from third parties, and 
the NASA license doesn't permit this. 


We urge you not to use this license. In addition, if you are a United States citizen, 
please write to NASA and call for the use of a truly free software license. 


https://www.gnu.org/licenses/license-list.html#4NASA 
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With Regards to Licensing 


a“ 


We are seeking the Apache 2.0 licenses based on the current statement from the 
gnu.org regarding its advice for adoption, explained below. 


We feel that this would hinder contributors and give pause to anyone considering 
augmenting and extending our code with other existing code bases (e.g. ‘mash-ups’) 


https://www.gnu.org/licenses/license-list.html#4NASA 


a 
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number of projects released at software.nasa.gov 
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Recent Open Source 
Efforts 


(only talking about EOSDIS, actively “working” repos) 


Some of our more active code bases... 


OnEarth https://github.com/nasa-gibs/onearth 


https://github.com/nasa-gibs/worldview 


https://github.com/nasa/earthdata-search 


Common Metadata Repository httos://github.com/nasa/Common-Metadata-Repository 


Metadata Management Tool https://github.com/nasa/mmt 


Approved for open source, not public yet 
pyCMR https://github.com/ghrcdaac/cmr 


@ - more on these later 


This is great! 
Cant wait to really start giving Dack! 
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Looking at Worldview: 
How can we help? 


University Students Working on NASA FOSS 


University of Pennsylvania held a FOSS class in Fall of 2016. 


A pair of students decided to tackle working on Worldview to get their feet wet 
in contributing. 


The blogged about it! 


https://www.cis.upenn.edu/~cdmurphy/foss/fall2016/ 
http://dylancodes.tumbir.com/tagged/cis399 
https://leesaf.tumblir.com/ 
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University Students Working on NASA FOSS 


Great Idea! 


Off to a good, Dut rocky start! 


Setting Up the Worldview Dev Environment on Linux 


So! After quite an adventure trying to figure out how to set up the environment 
and fighting with vagrant, I’ve come to these concise instructions on getting this 
set up. Please note, I am using Ubuntu 14.04, so different Linux distros may 
have different steps for unpacking into the localhost. 


The following are slight modifications on the anual! Setup instructions on the 


project github: 
1. Download and install Node.js using the instructions on their site. 
2. Clone the repo: 


git clone https://github.com/nasa-gibs/worldview.git 


cd worldview 


Getting Started with Cesium! 


Unfortunately, a number of issues (mostly related to my lack of experience with 
web development) came up, and I will be unable to work with NASA’s 
Worldview. Their team was very accommodating and did their best, but 


ultimately the project was too large and didn’t have a large base of contributors 


that were able to help one another with working on issues. 


However, I am very excited to begin contributing to Cesium, an open-source 
library for JavaScript for 3D globes and maps! Installing the program was as 
easy as typing ‘npm install cesium’, and forking/cloning the Github repo was also 
straightforward. What’s more exciting is that other Penn students have already 
been contributing to this project (so I will have more face-to-face resources to 
rely on), and to boot, the founder of the project is actually a faculty member in 
the computer science department. 


http://dylancodes.tumblr.com/post/151762667869/getting-started-with-cesium 


We've made great strides since then! 


Project Roadmap 
https://github.com/nasa-gibs/worldview/wiki/Worldview-Roadmap 

Specific README Sections on Installation and Contribution 

More transparent testing: 


https://travis-ci.org/nasa-gibs/worldview 


More transparent issue tracking: 


https://waffle.io/nasa-gibs/worldview 


What else could go wrong? 


e Sometimes people fork projects 
and never attempt to remerge 

e Sometimes code history gets 
deleted 

e Sometimes people leave 
projects without identifying 
SUCCeSSOrs 

e Sometimes the direction of the 
project can be unclear 

e Sometimes code just gets 
thrown over the wall 


https://pixabay.com/en/angel-arc-de- obi arc-arch- 2179479/ (licensed cco) 
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NASA is full of process and procedure. 
HOW Can we improve upon this one? 
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Starting with a clear plan. 


1. Wewant to use 


PROBLEM DESCRIPTION 
DEVELOPMENT TEAM 
WORKPLAN 


and reuse 
and reuse our software. 
2. We have a willing group of volunteers 


We have vision of how we want to evolve. 
4. We have an opportunity to improve on 
“Execution” and “Releasing” in the open. 


https://commons.wikimedia.org/wiki/File:OSSD_process_data_diagram.png 


Embracing 
Open Source 


(another case study in which we are starting on the ground floor) 
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Q> CUMULUS 
Prototyping DAACS in the Cloud 


- 


What 1s Cumulus? 


Lightweight cloud-native framework for data ingest, archive, 
distribution and management 


Goals 
- Provide core DAAC functionality in a configurable 
manner 
- Enable DAACs to help each other with re-usable, 
compatible containers (e.g. widely applicable GIS 
components or sub-setters) 
- Enable DAAC-specific customizations 


configures/monitors 


configures/monitors adds prodiicts 


adds products 


extends/improves 


Product 
Workflow 


Glacier 


aa ESDIS Provided/Maintained 
(i DAAC A Provided/Maintained 
L_] DAAC B Provided/Maintained 


ESDIS Provisioned Cloud LJ Other Provided/Maintained 
Infrastructure 


On Premise 
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extends/improves 


configures/monitors 


Distribution, Analysis, 
and Access Services 


[4 DAAC B Provided/Maintained 


On Premise 


ESDIS Provisioned Cloud || Other Provided/Maintained 


Infrastructure 
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extends/improves 


configures/monitors 
adds products 


configures/monitors 
adds products 


extends/improves extends/improves 


Product 
Workflow 


ESDIS Provided/Maintained 
DAAC A Provided/Maintained 


DAAC B Provided/Maintained 


L_) Other Provided/Maintained 


On Premise 


ESDIS Provisioned Cloud 


peels Infrastructure 
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extends/improves 


configures/monitors 


configures/monitors 
adds products 


adds products 


Product 
Workflow 


Product 
Workflow 


Product 
Workflow 


|/Maintained 
ad 


ed/Maintained 
sd 


OnPremisa Distribution, Analysis, 


and Access Services 


ESDIS Provisioned Cloud 
Infrastructure 
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We Nave long been a system of stovepipes 
and “not invented here’ types. And that is 


Changing as we evolve 


a 


We need to streamline, and create unified, 
interoperable system that can grow with us. 
Something we can claim group ownership of. 
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So... how do we do this “right” 


- 


Drafting a contribution guide 


iF 


Provide working definitions of the high-level components of the 
Cumulus system, including specifying which of those components are 
governed by this document. 

Establish roles and responsibilities for contributions to Cumulus NASA‘s 
EOSDIS 

Identify key communication flows, as well as information on 
documentation, testing and deployment paradigms 

Outline high-level process expectations for Cumulus contributions and 


provide example process flows for these contributions 
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Mimic the Apache Way, but for a simpler use 


Case and narrower audience 


— Project Roles and Responsibilities 


Project 
Leadership Technical 
Team Leadership 
e S Team O Committers 
a> 
Project O {0} O 
en CN CG 
Board 
“0 “” “\ Contributors 
As we scale (up or down) we can oO O 
adjust/combine/tailor these roles. rN 


We can adapt to other projects/systems. 


Form a Working Group! 


Group Membership 


@ Kathleen Baynes @ Christine Smit 


@ Christopher Lynnes @ Darla Werner 


@ Mark McInerney @ Taylor Wright 
@ Chris Stoner @ Patrick Quinn 
@ lan Schuler @ Christopher Torbert 
@ Michael Gangl @ Wayne Burke 


Individual Assignments 


Volunteer For An Assignment / Add A Resource 


@ Jason Werpy 

@ Manil Maskey 
Rustem Albayrak 

@ Jason Duley 

@ Lewis McGibbney 


@ Ajinkya Kulkarni 


Understand your Obligations and Limitations 


e Schedule regular meetings with the NASA Office of Patent 
Counsel 


O 


O 
O 
O 


Do we need contributor licenses agreements? 

Can we use docker hub? 

What system evolutions require new a release process? 
How do we keep NASA informed of how we are 
proceeding? 

How can we help in guiding NASA policy at large? 


Denouement 


(so, what's next?) 


“a 


. We are abiding by these principles in Cumulus now. 


By October 2017 (like, tomorrow in government time), 
weewill:be.rolling out this policy and making it “official”. 


There is still work to do. We are just Starting this journey. 


= https://pixabay.com/en/road-asphalt-space-sky-clouds-220058/ (licensed CCO) 


Questions? 


<atle. Daynes@nasa.ov 


